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Abstract 

Background: Globally, the incidence of sexually transmitted infections (STI) is rising, posing a challenge to its 
control and appropriate management. Text messaging has become the most common mode of communication 
among almost six billion mobile phone users worldwide. Text messaging can be used to remind patients about 
clinic appointments, to notify patients that it is time for STI re-testing, and to facilitate patient communication with 
their health professionals with any questions and concerns they may have about their sexual health. While there 
are a handful of systematic reviews published on short message service (SMS) interventions in a variety of health 
settings and issues, none are related to sexual health. We plan to conduct a systematic review to examine the 
impact text messaging might have on interventions for the prevention and care of patients with STIs. 

Methods/Design: Eligible studies will include both quantitative and qualitative studies published after 1995 that 
discuss the efficacy and effectiveness of SMS interventions for STI prevention and management using text 
messaging. Data will be abstracted independently by two reviewers using a standardized pre-tested data abstraction 
form. Inter-rater reliability scores will be obtained to ensure consistency in the inclusion and data extraction of studies. 
Heterogeneity will be assessed using the I 2 test and subgroup analyses. A nonhypothesis driven inductive reasoning 
approach as well as a coding framework will be applied to analyze qualitative studies. A meta-analysis may be 
conducted if sufficient quantitative studies are found using similar outcomes. 

Discussion: For this protocol, we identified ten related systematic reviews. The reviews were limited to a particular 
disease or setting, were not exclusive to SMS interventions, or were out of date. This systematic review will be the first 
comprehensive examination of studies that discuss the effectiveness of SMS on multiple outcomes that relate to STI 
prevention and management, covering diverse settings and populations. Findings of the systematic review and any 
additional meta-analyses will be published and presented to our key knowledge users. This information will provide 
the evidence that is required to appropriately adopt text messaging into standard practice in STI care. 
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Background 

Increasing rates of reported sexually transmitted infections 
(STIs) remain a major public health challenge worldwide. 
Despite active and passive surveillance activities and mul- 
tiple interventions aimed at increasing case finding and 
treatment, human immunodeficiency virus (HIV), chla- 
mydia (CT), gonorrhea (GC), syphilis, herpes, and human 
papillomavirus (HPV) infections impose a large burden on 
health resources [1,2]. 

In the past two decades, the population use of new 
technologies such as mobile phones and the internet has 
exploded. The Canadian Wireless Telecommunications As- 
sociation figures showed that almost 27 million Canadians, 
representing more than 81% of the Canadian population, 
subscribed to mobile phones in 2012 [3]. Of those who 
own smart phones in Canada, according to Rogers 
Communications survey in 2012, text messaging was 
noted to be the top application (88% users) [4]. Further- 
more, a Statistics Canada 2010 survey revealed that 78% 
of Canadian have a cell phone, and wireless-only homes 
increased to 13% from 8% in 2008 [5]. 

Text messaging is commonly used in a variety of med- 
ical contexts. Text messaging allows patients and pro- 
viders to Interact' via two-way communication [6], which 
can allow for enhanced support by health-care providers 
to confirm medication taking [7,8], to enable patients to 
ask medication questions to pharmacists [9], and to alert 
clinic staff of problems [10]. SMS messages can be cus- 
tomized to fit the needs of specific individuals by deliver- 
ing tailored messages that are more likely to catch the 
individuals attention and be perceived as personally rele- 
vant and interesting [11]. Moreover, because messages ex- 
changed between health-care providers and clients are 
stored on the device, there is the potential for them to be- 
come part of the clients health-care record. 

SMS has been used in other health contexts in the form 
of smoking cessation [12-14], cancer [15], diabetes 
[16-23], asthma [24-34], diet or weight management [35], 
obesity [36], and reminder programs [37-43]. In the con- 
text of sexual health services, SMS has been used in the 
form of appointment reminders [44,45], STI rescreening 
reminders [46,47], provision of STI results [48-51], commu- 
nication of STI information [10,52], sexual health promo- 
tion [53,54], and assistance with contact- tracing [55-58]. It 
has also been shown to decrease the amount of time from 
diagnosis to treatment among positive chlamydia patients 
[49], increase the rate of retesting among high risk groups 
[59], and reduce the amount of missed clinic appoint- 
ments [10,44]. Others report that sexual health knowledge 
and behavior is increased by delivering educational mes- 
sages via text message [53,54]. Because younger people 
have higher risk of acquiring STIs such as GC and CT, 
text messaging, which is commonly used by this segment 
of the population, can be an effective tool to reach and 



help them in STI management and care. Today, text messa- 
ging and email managed on handheld devices are overtak- 
ing traditional voice calling for personal communication 
in Europe and North America. However, despite wide- 
spread use, there is little consensus about the actual im- 
pact that SMS interventions have on the prevention and 
control of STIs. The purpose of this systematic review is 
to examine the use of SMS to improve the treatment and 
prevention of STIs. Our research will attempt to answer 
the following questions: (a) What are the various ways 
that SMS use has been proposed to improve STI preven- 
tion and management in quantitative studies with control 
groups? (b) What are the potential benefits and harms for 
participants of SMS interventions related to STI pro- 
grams? (c) What are the experiences and perceptions of 
people involved in STI-related SMS interventions? and (d) 
Why does an intervention work (or not), for whom, and 
in what circumstances? 

Methods/Design 

Inclusion/exclusion 

The following inclusion/exclusion criteria are based on 
Patient and Problem, Intervention, Comparison and Out- 
come (PICO) domains. 

Study design 

Eligible studies will include randomized and non- 
randomized controlled trials, pre- and post-test de- 
signs, non-experiment observational (cross-sectional, 
case-series, case studies) and qualitative papers that 
examine the benefits and other impacts of SMS inter- 
ventions on STIs. 

Population 

Individuals of any age who use cell phones and have been 
involved in an intervention that uses text messaging as pa- 
tient support to improve the treatment and prevention of 
STIs will be included. 

Intervention 

SMS or text messaging interventions that are delivered 
through a mobile electronic device to improve the treat- 
ment and prevention of STIs will be included. 

Comparator 

The comparison is the usual standard of care, or in the 
case of a randomized control trial, the comparison is the 
control condition. 

Outcome 

The a priori primary outcomes of interest include: (a) 
clinical outcomes (HIV viral suppression, STI clearance, 
STI re-infections); (b) adherence (for example, percent- 
age of missed appointments, adherence to medication), 
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(b) STI testing (for example, rates of primary testing, re- 
testing), (c) changes in STI knowledge or risk behavior 
(for example, increased condom use), (d) uptake of SMS 
for partner notification, (e) acceptability of SMS for STI 
interventions, and (f) any cost-effectiveness assessments. 
Secondary outcomes are: notification of test results, con- 
dom use, mental health outcomes (for example, anxiety 
and depression scores), quality of communication with 
clinicians, quality of care, feasibility of program delivery 
and privacy impact of SMS messages (for example, content 
of messages). Outcomes that are similar will be grouped 
for quantitative synthesis. Outcomes will be grouped based 
on an objective or subjective class (Table 1). We will in- 
clude other outcomes of interest identified during the 
literature review. 

Exclusion criteria 

The following data will be excluded: commentary or 
opinion publications without new data, publications be- 
fore 1996, research that does not include use of SMS/ 
text messaging, research that uses PDAs other than PDA 
phones, and studies with an email/social network-based/ 
landline telephone intervention. Studies using PDAs 
only (and not PDA phones) will be excluded because of 
their relatively uncommon use with most populations 
during their peak popularity (for example, often used by 
physicians but not their patients). 



Search strategy 

The databases that will be searched for journal articles, 
reports, editorials and abstracts include Ovid (for example, 
Cochrane Database of Systematic Reviews, Medline, 
Embase), Web of Knowledge (for example, Biosis, Web of 



Science), and EBSCO (for example, PsycINFO, ERIC, 
CINHAL, etcetera). The gray literature will be searched 
for reports, dissertations, conference proceedings and 
mobile health-related websites. Our search will include 
English and non-English-based databases. Since SMS is 
relatively new, the search will be limited to articles pub- 
lished between 1996 to August 2013. The following STI 
journals will be hand-searched by an inhouse librarian: 
Sexually Transmitted Diseases, Sexually Transmitted 
Infections, and AIDS Patient Care and STDs. 



Search terms 

Medical Subject Headings (MeSH), subject headings and 
keywords will be created by using language that describes 
text message interventions for STIs. Search terms will in- 
clude but will not be limited to: mobile health, mHealth, 
cell phone, mobile phone short message service, SMS, 
MMS, communication technologies, patient monitor- 
ing devices, wireless technologies, STI testing, sexually 
transmitted diseases, sexually transmitted infections, 
HIV, chlamydia, gonorrhea, herpes, Trichomonas vagi- 
nalis, and syphilis. Boolean combinations will create 
more specific searches using Ovid MeSH terms as the 
standard for developing a search strategy for each database. 

A health librarian will be consulted to ensure the opti- 
mal search strategy is being conducted. In addition, back- 
ward and forward citation searches of included studies, 
relevant evidence reviews and reports will also be done. 
Email letters will be sent out to scholars in leadership and 
other related fields to ask them to review the list of studies 
that we included and to suggest other studies that they 
thought might be missed. This list will be expanded upon 
during the data collection phase. 



Table 1 Outcomes classified on objective or subjective criteria 


Objective/semi-objective 


Subjective 


• Mortality 


• Mental health outcomes 


• Suppression of HIV viral load 


• Quality of life/functioning 


• Sexually Transmitted Infection (STI) clearance 


• Satisfaction with/Quality of care 


• STI re-infection 


• Quality of communication 


• Withdrawals/drop-outs 


• General physical health 


• Time to testing for an STI or HIV 


• Adverse events 


• Time of symptom onset to seeking medical treatment (first time, recurrence) 


• Continuation of condition 


• Time to uptake of diagnosis or treatment 


• Cost-effectiveness 


• STI testing rates 


• STI knowledge and behaviour 


• Correct clinical diagnosis or assessment 


• Communication uptake regarding STIs 


• Improvement in condition (i.e. signs and symptoms) 


• Feasibility of program delivery 


• Number and proportion of partners notified by short message service (SMS) 


• Privacy impact/assessment 


• Cost savings/reduction 


• Notification of test results 




• Condom use 
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Study selection and extraction process 

One reviewer will be responsible for creating a search 
strategy and will store all identified references in a 
shared RefWorks account. Once duplicates are manually 
removed, all publications found will be exported into an 
MS Access database. Two reviewers will then independ- 
ently read the titles and abstracts of the identified arti- 
cles and determine eligibility based on the specified 
inclusion/exclusion criteria. Any disagreements between 
the reviewers will be resolved by a third reviewer. Once 
the subset of publications meeting inclusion criteria is fi- 
nalized, each publication will be reviewed and its charac- 
teristics documented using a standardized pre-tested 
data extraction form. These forms will capture: the pur- 
pose of the SMS intervention, duration of the interven- 
tion, delivery frequency of text messages, study design, 
setting and outcomes. The reviewers will attempt to 
contact the authors of studies that are missing key data. 
The reviewers (CL, JM, and OW) will translate included 
studies written in French, Spanish. German, Mandarin 
or Korean, or use online translation software. 

Two reviewers will assess the studies with disagreement 
resolved by a third reviewer, and inter-rater reliability will 
be measured using kappa statistics. An inter-rater Kappa 
score will be assessed during the inclusion/exclusion phase 
of review, to ensure that a Kappa score at or above 0.8 is 
reached as measured by Cohens Kappa (k) statistical test 
[60]. If the measure falls below our threshold for high cor- 
respondence (0.8), the three reviewers will discuss until 
agreement is reached. 

Methodological quality 

The methodological quality will be assessed using appro- 
priate tools, including the Cochrane Collaborations Risk 
of Bias tool for randomized controlled trials, the Cochrane 
Effective Practice and Organization of Care groups tool 
for quasi-experimental designs, and the risk of bias tool 
developed in Waddington et al [61] study for regression- 
based studies (with special attention to confounding) [61]. 
Other observational studies will be assessed using the 
NOS score (Newcastle- Ottawa Quality Assessment Scale) 
[62]. The NOS score rates quality based on high risk 
(1 to 3 stars), medium risk (4 to 5 stars), or low risk 
(6 to 9 stars) NOS score [62]. If data allows, we will rate 
the overall quality of body of evidence using the GRADE 
system as it incorporates ratings for consistency, direct- 
ness, and precision per outcome across multiple studies in 
addition rating the overall validity and risk of bias (http:// 
www.gradeworkinggroup.org/) . 

It is usually necessary to consider the reliability or val- 
idity of the actual outcome measure being used (for ex- 
ample, several different scales can be used to measure 
quality of life or psychological outcomes). The reviewers 
will meet to discuss any differences in the interpretation 



of the scales measuring semi-objective and subjective 
outcomes. For bodies of evidence that include observa- 
tional research, we will also systematically assess the char- 
acteristics of each outcome, including dose-response 
association, plausible confounding that would change the 
observed effect, and the strength of association. We have 
registered our protocol with the Preferred Reporting Items 
for Systematic Reviews and Meta-Analyses (PROSPERO 
registration number CRD42013006503). 

Data analysis 

Qualitative synthesis of studies We will describe the 
clinical and methodological characteristics of the in- 
cluded studies, including their size, inclusion or exclu- 
sion of important subgroups, timeliness, and other 
relevant factors, both qualitatively and by using tables of 
study characteristics [63]. The strengths and limitations 
of individual studies and patterns across studies will be 
assessed and we will explain how design weaknesses or 
execution of the study (or groups of studies) could bias 
the results. 

Quantitative analysis If the systematic review includes 
randomized controlled trials or observational studies, we 
will conduct meta-analysis and the Cochrane Collabora- 
tions Review Manager 5.0 will be used [64]. In the first 
analysis, a fixed-effects model will be used, and a random- 
effects model will check against it to ascertain its robust- 
ness. We will extract comparable effect size estimates from 
included studies, together with 95 percent confidence in- 
tervals. Where possible, we will calculate standardized 
mean differences (SMDs) for continuous outcome vari- 
ables, and risk ratios (RRs) for dichotomous outcome 
variables. 

Treatment effects will be calculated as the ratio of, or 
difference between, treated and control observations in a 
consistent way, such that outcome measures are com- 
parable across studies. Thus, an SMD greater than zero 
(RR greater than 1) will indicate an increase in the out- 
come under the intervention as compared to the com- 
parison. An SMD less than zero (RR between 0 and 1) 
will indicate a reduction under the intervention as com- 
pared to the comparison. An SMD equal to (or insignifi- 
cantly different from) zero (RR equal to 1) will indicate 
no change in outcome over the comparison. Whether 
these relative changes represent positive or negative im- 
pacts will depend on meaning of the outcome in the 
context of the program being evaluated. We will only 
include one effect estimate per study. Where studies re- 
port multiple effect sizes according to subgroups of par- 
ticipants, we will report data on subgroups separately. 

If statistical heterogeneity is observed, a random-effects 
model will be used. Statistical heterogeneity between studies 
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will be examined visually using a I 2 statistic and a chi- 
squared test (a chi-squared P value of less than 0.10 or an 
I-squared (I 2 ) value equal to or more than 50% will be 
considered indicative of heterogeneity [65]. Furthermore, 
if heterogeneity is detected, subgroup analyses and meta- 
regression will be performed to identify factors that ex- 
plain the heterogeneity. The factors we identify a priori 
are: (a) type of study design, (b) type of intervention, (c) 
purpose of the SMS intervention, (d) duration of interven- 
tion, (e) study setting, (f) sex ratio, (g) age groups (for ex- 
ample, adolescents, young adults, older adults), (h) quality 
rating, (i) type of outcome (for example, STI type, type of 
device used (Apple android, etcetera), number of re- 
minders, number of appointments missed, contraceptive 
used), (j) English versus non-English literature, and (k) 
published versus unpublished literature. To evaluate the 
possibility of publication bias, we will use the Peters test 
and a color-enhanced funnel plot that will be done using 
STATA software (StataCorp. 2011. Stata Statistical Soft- 
ware: Release 12. College Station, TX: StataCorp LP.) 
[66,67]. 

Qualitative analysis We will employ interpretive de- 
scription to answer the qualitative questions in our re- 
view [68]. Interpretive description, developed by Thorne 
et al. in 1997, is applied to qualitative research findings 
to solve a clinical problem as opposed to exploring a 
topic as an end goal (Thorne [68]). This strategy has two 
phases: (a) deriving findings inductively from data with- 
out imposing predetermined hypotheses, and (b) gener- 
ating results that apply to a real-world clinical practice. 
We will review qualitative data from included studies, 
develop a coding framework to code data using NVivo, 
and hold weekly discussions to resolve conflicts and ar- 
rive at final conclusions. 

Discussion 

While there has been an explosion in the number of ar- 
ticles and studies on text messaging use in health inter- 
ventions, few reviews have conglomerated the literature 
related directly to SMS and STIs. Ten systematic reviews 
about mobile interventions for promoting sexual health 
were identified ([69-78]; Additional file 1). The reviews 
were limited to a particular disease or setting, were not 
exclusive to SMS interventions, or were out of date. 

SMS technology and use has evolved and has ex- 
panded in multiple health-care settings, and the number 
of studies related to SMS interventions for STI has dra- 
matically increased since previous reviews were done. 
Although the reviews by Horvath et al. [69], Chavez 
et al, Zou et al. and Velthoven et al. [70-72] present im- 
portant findings with respect to text messaging and sex- 
ual health outcomes, they do not cover multiple efficacy 
and effectiveness outcomes of SMS interventions for a 



broad spectrum of STI prevention and control. Broad re- 
views such as the one by Sorensen et al. [73] and by 
Chavez et al. [70] on the impacts of eHealth and other 
digital media may be useful; however, the girth of infor- 
mation on non-SMS information and communication 
technologies often overshadows the focused questions that 
health providers may seek on mHealth specific interven- 
tions. There have been a number of recent research papers 
specific to SMS and STIs with higher quality evidence. 
Therefore, an up-to-date review with a synthesis of current 
evidence is warranted. 

Significance of this review 

A host of new remote monitoring and communication 
technologies are available, allowing providers to interact 
with patients anywhere and anytime, and patient engage- 
ment is key to managing STIs [79-81]. Cell phones, per- 
sonal devices that are highly convenient to use, are 
particularly suited for leveraging the time and expertise 
of providers in communication with their patients. This 
prompt and personal communication can effectively en- 
gage patients in their knowledge acquisition and motiv- 
ate them towards effective self-care. Like any consumers, 
patients as the primary users of health services prefer to 
have many options for communicating with their pro- 
viders. Text messaging via mobile phones could not only 
provide a convenient option [82], but could also decrease 
the need for booking repeat appointments through timely 
doctor-patient communication, thereby reserving scarce 
health resources for those who need face-to-face encoun- 
ters with clinicians. 

This synthesis is particularly important as there is a 
lack of quality evaluations of SMS interventions on mul- 
tiple outcomes affecting STI management. Researchers 
have attempted to empirically assess the effectiveness of 
SMS interventions but the data are sparse and have been 
collected with small sample sizes. Furthermore, many 
systematic reviews attempting to assess SMS interven- 
tions were conducted before randomized controlled tri- 
als on key outcomes were published. Synthesizing data 
from numerous studies will provide greater confidence 
in the effectiveness of these interventions, especially if 
the data allows for a meta-analysis. Moreover, there are 
conflicting results about the acceptability of some SMS 
interventions such as receiving results of laboratory tests 
as well as interventions for partner notification. A know- 
ledge synthesis will provide more power to assess these 
conflicting reports and provide a pooled estimate of ac- 
ceptability with reduced uncertainty. 

Text messaging shows immense potential for preven- 
tion and management of STIs. However, there is a lack 
of consensus on its acceptability, feasibility and cost- 
effectiveness for different STIs, populations, settings and 
uses. The systematic review will be the first evaluation of 
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the scope of SMS use in clinical and community settings 
for all levels of STI prevention and treatment. This infor- 
mation will provide the evidence that is required to make 
text messaging standard practice in STI care. 

Additional file 



Additional file 1: Summary often systematic reviews found 
through a scoping review [83]. 
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